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(Dated: May 9, 2007) 

We present a study of ecy and /u/ry events using 1109 (1009) pb _1 of data in the electron (muon) 
channel, respectively. These data were collected with the DO detector at the Fermilab Tevatron 
pp Collider at — 1.96 TeV. Having observed 453 (515) candidates in the ecy (nfi~y) final state, 
we measure the Z^j production cross section for a photon with transverse energy Et > 7 GeV, 
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separation between the photon and leptons ARe-y > 0.7, and invariant mass of the di-lepton pair 
Ma > 30 GeV/c 2 , to be 4.96 ±0.30 (stat. + syst.) ±0.30 (lumi.) pb, in agreement with the standard 
model prediction of 4.74 ± 0.22 pb. This is the most precise Zj cross section measurement at 
a hadron collider. We set limits on anomalous trilinear Zyy and ZZy gauge boson couplings of 
-0.085 < hj < 0.084, -0.0053 < hj < 0.0054 and -0.083 < h§ < 0.082, -0.0053 < hf Q < 0.0054 
at the 95% C.L. for the form-factor scale A = 1.2 TeV. 

PACS numbers: 12.15.Ji, 13.40.Em, 13.85.Qk 



The analysis of vector boson self-interactions provides 
an important test of the gauge sector of the standard 
model (SM). At the tree level, a Z boson cannot couple 
to a photon. Various extensions of the SM [l[ predict 
large (anomalous) values of the trilinear couplings ZZ7 
and ^77 that result in an excess of photons with high 
transverse energy (Et) compared with the SM predic- 
tion. Consequently, the cross section for Z7 production 
will be higher than that predicted by the SM. An obser- 
vation of either an enhancement of the cross section or 
an excess of photons with high Et would indicate new 
physics @. 

Previous studies of Z boson production in association 
with a photon were made at the Fermilab Tevatron pp 
Collider by the CDF 0] and DO @, [Icollaborations, 
and at the LEP collider by the ALEPH @, DELPHI Q, 
L3 U, and OPAL [§] collaborations. The combined LEP 
results are available in Ref . All results are consistent 
with SM predictions. 

In this work, we present a measurement of the Z7 cross 
section and a search for anomalous trilinear ZZj and 
Zjj couplings. We follow the framework of Ref. [ill ], 
where the ZVj (V — Z, 7) couplings are assumed only 
to be Lorentz and gauge invariant. Such ZVj couplings 
can be parameterized by two CP- violating (h\ and h^) 
and two CP-conserving (h^ and h\) complex parame- 
ters. Partial wave unitarity is ensured by using a form- 
factor parameterization that causes the coupling to van- 
ish at high center-of-mass energy VI: \i( = . 

Here, A is a form-factor scale, hY are the low-energy ap- 
proximations of the couplings, and n is the form-factor 
power. In accordance with Ref. [HI], we set n = 3 for 
and n = 4 for hXi- In this analysis, we set limits only on 
the real parts of the anomalous couplings, Re(hY)- For 
convenience we omit the notation Re and refer to symbols 
hj as the real parts of the couplings throughout the text. 

The signal sample is selected by requiring a final state 
that consists of a photon and a pair of either muon or 
electron candidates. The e + e~ and (J. + fi~ pairs can be 
produced either by the decay of an on-shell Z boson or 
via a virtual Z boson or a photon through the Drell-Yan 
production mechanism. We do not distinguish between 
these two processes. The photon can be produced by final 
state radiation (FSR) off both charged leptons or by one 
of the partons in the p or p through initial state radiation 
(ISR). We collectively refer to all these processes as Zj 
production. 



Data for this analysis were collected with the DO de- 
tector at the Tevatron Collider at pp center-of-mass 
energy ^/s — 1.96 TeV between October 2002 and 
February 2006. The integrated luminosity is 1109±68 
(1009±62) pb -1 [12} for the electron (muon) final state. 

The DO detector [l~3[ is a multi-purpose detector de- 
signed to operate at the high luminosity Tevatron col- 
lider. The main components of the detector are an inner 
tracker, liquid- argon/uranium calorimeters, and a muon 
system. The inner tracker consists of a silicon microstrip 
tracker (SMT) and a central fiber tracker (CFT), located 
in a 2 T superconducting solenoidal magnet and capa- 
ble of providing measurements up to pseudorapidities 
of \rj\ pa 3.0 and I77I « 1.8, respectively. The calorime- 
ter is divided into three sections which cover a wide 
range of pseudorapidities: the central calorimeter (CC) 
for \r}\ < 1.1 and two end calorimeters (EC) which extend 
coverage to |?7| « 4. The calorimeters are longitudinally 
segmented into electromagnetic (EM) and hadronic sec- 
tions. The muon system is the outer subsystem of the 
DO detector. It includes tracking detectors, scintillation 
trigger counters, and a 1.8 T toroidal magnet, and has 
coverage up to |?/| ~ 2.0. Luminosity is measured us- 
ing plastic scintillator arrays located in front of the EC 
cryostats and covering 2.7 < |ry| < 4.4. 

The DO detector utilizes a three-level (LI, L2, and L3) 
trigger system. In the electron decay channel, we require 
events to satisfy one of the high-£>r electron triggers. 
At LI, these triggers require an event to have an energy 
deposit of more than 10 GeV in the EM section of the 
calorimeter. At L3, additional requirements are imposed 
on the fraction of energy deposited in the EM calorimeter 
and the shape of the energy deposition. Single high-£r 
triggers are about 99% efficient for selecting a pair of elec- 
trons from Z — * ee decays. In the muon decay channel, 
we require events to satisfy single and di-muon triggers. 
The single muon trigger requires hits in the muon sys- 
tem scintillators and a match with a track at LI, and, in 
portions of the data set, also requires spatially-matched 
hits in the muon tracking detectors. At L2, muon track 
segments are reconstructed and a px requirement is im- 
posed. At L3, some of the triggers also require a re- 
constructed track in the inner tracker with transverse 
momentum (pt) greater than 10 GeV/c. Di-muon trig- 
ger requirements on individual muon candidates are less 
stringent than those of single muon triggers, but they 
require two muon candidates at LI. The muon trigger 
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definitions were changing over the period of time when 
the data set was collected, therefore, to calculate trigger 
efficiencies we divide the data into several subsets and 
estimate the trigger efficiency separately for each subset. 
As determined from the Monte Carlo simulation, the re- 
sulting overall muon trigger efficiency is 68% to select a 
pair of muons from Z — > /i/i decays. 

We select Z boson candidates in the electron channel 
by requiring two isolated energy deposits (electromag- 
netic clusters) corresponding to Et > 15 GeV in the 
calorimeter with at least 90% of their energy deposited in 
the EM calorimeter, have a shower shape consistent with 
that of an electron, have matched tracks, and form an 
invariant mass M ee > 30 GeV/c 2 . To satisfy single EM 
trigger requirements, we require at least one of the elec- 
tron candidates to have Et > 25 GeV. As Zj production 
yields leptons predominantly at small pseudo-rapidity (77) 
and tracking reconstruction efficiency decreases rapidly 
with 77 in the endcap region, we require at least one elec- 
tron candidate to be reconstructed in the central region 
of the calorimeter with \rj\ < 1.1. The other electron 
can be reconstructed either in the central region (CC- 
CC topology) or in the endcap (CC-EC topology). 

To select Z — ► /i/_t events we require the event to have 
a pair of muon candidates each with pt > 15 GeV/c, 
reconstructed within the muon system acceptance, that 
match to central tracks. At least one of the muon candi- 
dates must have pt > 20 GeV/c. To suppress the back- 
ground from hadronic bb production, with b quarks de- 
caying semi-leptonically, we require muon candidates to 
be isolated from other activity in both the central tracker 
and the calorimeter. The background from cosmic ray 
muons is suppressed by rejecting muon tracks that are in- 
consistent with being produced at the interaction point. 
This background is further reduced by rejecting muon 
candidates that are reconstructed back-to-back with an 



opening angle Aa w = \A(f> 



AO 



fifi 



■2w\ < 0.05. Both 
muon candidates must be consistent with being produced 
at the same vertex, i.e., they must originate within 2 cm 
from each other. The event is also rejected if the invari- 
ant mass of the muon pair M MM < 30 GeV/c 2 . 

Each event must have at least one photon candi- 
date identified in the central region of the DO detector 
(| 77 1 < 1.1) that deposits at least 90% of its energy in the 
EM calorimeter and has a shower shape consistent with 
that of a photon. The photon candidate Et must exceed 
7 GeV, and it must be separated from both leptons by 0.7 
in AR — \[{$t — 7 ) 2 + (r]£ — ?y 7 ) 2 . As electrons are not 
a significant source of a background to photon candidates 
in Zj final state, we do not require an anti-track match 
to the photon candidate. To reduce contamination from 
EM-like jets, we require the photon to be isolated from 
reconstructed tracks in the annulus of 0.05 < AR < 0.4 
- the scalar sum of all the momenta of the tracks in this 
annulus must be below 1.5 GeV/c. These track isolation 
requirements result in overall improvement (about 8%) 



of photon identification efficiency and smaller systematic 
uncertainty due to simulation of converted photons than 
that employed in the previous analysis [5J]. The Z{pj) 
candidate events that pass all the selection criteria are 
collectively called the signal sample. 

We determine the electron and muon identification ef- 
ficiencies using the tag and probe method [14| on Z — > It 
data samples. In the electron channel, we parameterize 
the efficiency as a function of 77, Et, and z-coordinatc 
of the interaction vertex. The reconstruction and trigger 
efficiencies are then calculated using the signal Monte 



Carlo samples processed with the GEANT-based [15 1 
DO simulation package. The efficiency to reconstruct a 
pair of electrons is estimated to be (64.6 ± 2.2)% for the 
CC-CC topology and (50.8 ± 2.4)% for the CC-EC topol- 
ogy, resulting in the combined reconstruction and trigger 
efficiency in the electron channel to be (64.0 ± 2.3)% for 
the CC-CC topology and (50.3 ± 2.4)% for the CC-EC 
topology, respectively. The efficiency to reconstruct a 
pair of muons is measured to be (78.8 ± 1.6)%, result- 
ing in (53.4 ± 1.2)% combined reconstruction and trig- 
ger efficiency. The main contribution to the uncertainty 
in both channels is from the lepton identification uncer- 
tainty. As no clean high- Et photon sample exists, we 
measure the photon identification efficiency using photon 
Monte Carlo simulation. The quality of how well Monte 
Carlo simulation describes EM objects in data is studied 
on Z — ► ee candidate data sample. The data and Monte 
Carlo electron Et distributions agree at (99 ± 1)%. We 
normalize the photon efficiency by this number to correct 
for data-Monte Carlo simulation difference. The photon 
identification efficiency is parameterized as a function of 
Et', it is measured to rise from ~ 87% at a photon Et 
of 7 GeV to - 95% for photons with E T above 75 GeV. 

The main background to the Zj process is Z+jet pro- 
duction, where an EM-like jet is misidentified as a pho- 
ton. The procedure is to count the number of jets in 
Z+jet events that satisfy "loose" EM identification cri- 
teria and scale that by the probability for a jet that passes 
"loose" EM requirements to also pass the rest of the EM 
identification criteria. This is slightly complicated by the 
presence of real photons in the jet data. We correct for 
the contribution due to real photons by removing them 
from the sample when determining the jet misidentifica- 
tion rate. In detail, to estimate the Z+jet background 
to the Z7 process, we loosen the shower shape and track 
isolation requirements on the photon candidates. If such 
"loose" photon candidates' Et spectrum is denoted as 
cIN-em/Et and that for photon candidates is denoted as 
cLN 1 /Et 1 then the number of Z+jet background events 



in the signal sample, Nz+j e t 
using the following formula: 



bkg, can be determined by 



N 



Z+jet bkg 



/ 



dN-i 



EM 



E, 



dN n 



dE T , (1) 



where e 7 is the £+-dependent photon identification ef- 
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ficiency (measured with respect to the "loose" photon 
identification criteria), and / is the ^-dependent prob- 
ability of a jet that satisfies "loose" EM criteria to pass 
shower shape requirements. This probability is deter- 
mined from a data sample that has at least one high- 
quality jet candidate that satisfies the DO jet trigger 
requirement. Such data are primarily due to multijet 
production, and any photon-like cluster is likely to be a 
misidentified jet. The i/r-dependent probability is mea- 
sured as the ratio of all EM clusters that pass all photon 
identification criteria to the total number of "loose" pho- 
ton candidates reconstructed in the sample. There are 
real photons in the sample from direct photon produc- 
tion (7+jet processes), leading to an enhancement in the 
misidentification rate for photons with high Et- This 
contribution is removed by taking into account the rel- 
ative cross sections of multijet and 7+jet processes and 
using the 7+jet Monte Carlo simulation. The misidenti- 
fication rate is about 20% at Et of 7 GeV and rapidly de- 
creases to about 0.5% for Et > 60 GeV. The background 
suppression was improved, compared with the previous 
analysis, by improving the performance of the DO track 
reconstruction software and by increasing track-isolation 
requirements imposed on the photon candidate. 

We predict 29.5 ± 4.8(stat.) ± 3.1(syst.) back- 
ground events for the CC-CC topology and 
25.7 ± 3.8(stat.) ± 2.5(syst.) background events for the 
CC-EC topology in the electron channel. Thus, the back- 
ground in the combined electron channel is estimated to 
be 55.2 ± 6.1(stat.) ± 5.6(syst.) events, while that in 
the muon channel is 61.3 ± 6.5(stat.) ± 6.2(syst.). Back- 
grounds from other processes are estimated to be negli- 
gible. 

We estimate the acceptance and efficiencies of the 
event selection criteria using Monte Carlo samples pro- 
duced with the leading-order (LO) Z7 generator and 
the simulation of the DO detector. The CTEQ6L1 [jj] 
parton distribution function (PDF) set is used. The un- 
certainty on the acceptance due to the choice of the PDF 
set is estimated to be 4.7% following the procedures de- 
scribed in Ref. [l6j |. We estimate the product of over- 
all reconstruction efficiency and geometrical acceptance 
of selection criteria to be 0.049 ± 0.003 for the CC-CC 
topology and 0.026 ± 0.002 for the CC-EC topology in 
the electron channel and 0.086 + 0.005 in the muon chan- 
nel. 

After applying all of the event selection criteria, we ob- 
serve 453 (308 CC-CC and 145 CC-EC) ee 7 events, while 
the SM predicts 393.4+37.6 (255.7 CC-CC and 137.7 CC- 
EC) signal events with 55.2 ± 8.3 background events. In 
the muon channel, we observe 515 events compared to 
an estimated 410.5 ± 35.9 SM fifij events and 61.3 ± 9.0 
background events. Uncertainty due to the PDF choice 
is the main contributor to the SM signal uncertainty. A 
major contribution to the uncertainty in the number of 
background events is the uncertainty in the measurement 
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FIG. 1: Di-lepton+photon vs. di-lepton mass of Z7 candi- 
date events. Masses of candidates in the electron channel 
are shown as open circles, while those in the muon mode are 
shown as stars. 



of the jet misidentification rate. 

The invariant mass of di-lepton and photon versus di- 
lepton invariant mass scatter plot is presented in Fig. [T] 
The structure of this distribution reflects the three pro- 
cesses through which the final states can be produced. 
Following from the kinematics, the ISR events have two 
leptons from on-shell Z boson decay with Mu ~ Mz 
and a photon, emitted by one of the interacting partons, 
resulting in M« 7 > Mz, and hence the ISR events popu- 
late the vertical band. The on-shell Z boson FSR events 
cluster along the horizontal band at M« 7 ss Mz and 
have Mu < Mz- Drell-Yan events populate the diagonal 
band with Mu ~ Mu-y- The di-lepton and three-body 
mass distributions from data as well as the SM predic- 
tion with the background overlaid are shown in Fig. O 

The measured value of the combined ££j cross section 
times the branching ratio for Z(-f) — > ££j for a photon 
with Et > 7 GeV, separation between the photon and 
leptons ARfy > 0.7, and invariant mass of the di-lepton 
pair M u > 30 GeV/c 2 , is 4.96 ± 0.30(stat. + syst.) ± 
0.30(lumi.) pb. The combined statistical and systematic 
uncertainties contribute to the first uncertainty term, and 
the second uncertainty term is due solely to the uncer- 
tainty of the luminosity measurement. The measured 
cross section value agrees well with the theoretical pre- 
diction of 4.74 + 0.22 pb, calculated using the NLO event 
generator [17 1. 

The Et distribution of the photon candidates in data, 
compared with the background and SM prediction is il- 
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FIG. 3: Photon Et spectrum for ll-y data (solid circles), 
Z+jet background (dashed line histogram), and Monte Carlo 
signal plus background for the SM prediction (solid line his- 
togram) and for the expected distribution when hj = —0.18 
and hj — 0.016 (dash-dot line histogram). The shaded bands 
illustrate the systematic and statistical uncertainty on the SM 
Monte Carlo and Z+jet prediction. The Monte Carlo distri- 
butions are normalized to the luminosity. 



FIG. 2: (a) Di-lepton mass and (b) di-lepton+photon mass 
distributions of £(."/ data (solid circles), Z+jet background 
(dashed line histogram), and the standard model plus back- 
ground (solid line histogram). The shaded bands illustrate 
the systematic and statistical uncertainty on the Monte Carlo 
and Z+jet prediction. The Monte Carlo distribution is nor- 
malized to the luminosity. 



lustrated in Fig. [3l The Et distribution expected from 
a new physics process with anomalous couplings is also 
shown as a dashed line. As the measured cross sec- 
tion agrees well with the SM expectation, we set limits 
on the real parts of the trilinear gauge ZZj and Zjj 
couplings by comparing the photon candidate Et distri- 
bution, measured in data, with the expected Et distri- 
bution from anomalous Zj production for a given set of 
ZZj and Z77 coupling values. The simulation of anoma- 
lous Z7 production is obtained using the leading-order 
Zj Monte Carlo generator [ll| . We take into account the 
next-to-leading order effects by correcting the leading- 
order photon Et distributions, both for the SM and 
the anomalous Z7 processes, with the -&r-dependent K- 
factor obtained from the next-to-leading-order Z7 gener- 
ator [13]. 

In this analysis, we set limits on the real parts of CP- 
conserving anomalous trilinear couplings h^ and h^ for 
the form- factor scale A = 1.2 TeV. This choice of A is 



not arbitrary, and is the highest possible for this current 
data sample that still ensures the limits not to exceed 
the unitarity boundaries. We generate samples of Z7 
events varying the values of the anomalous couplings h^ 
and hXo, and for each value we compare the photon Et 
spectrum from data with that from the simulation with 
the background component overlaid. 

The likelihood of the data-Monte Carlo simulation 
match is calculated assuming Poisson statistics for the 
signal (both in the data and MC samples) and the back- 
ground. All systematic uncertainties on backgrounds, ef- 
ficiencies, and luminosity are taken to be Gaussian. The 
two-dimensional 95% C.L. limits are shown in Fig. [4] 
We also measure 95% C.L. limits on individual anoma- 
lous couplings by setting the other couplings to their SM 
value (zero) . These limits are presented in Table U and 
shown in Fig. 0] with crosses. The limit on h\ (/i^o) 
is the same within the precision of this measurement as 
the limit on h^ (hY ) [l7j. We also obtain one dimen- 
sional 95% C.L. limits on the real parts of CP-conserving 
anomalous couplings for the form-factor scale A = 1 TeV 
to be -0.111 < hJ Q < 0.113, -0.0078 < hj < 0.0079 
and -0.109 < /if < 0.110, -0.0077 < ftf < 0.0078. 
This is roughly a factor of two improvement compared 
to the results obtained in Ref. [H. It should be noted 
that Ref. || could not use form- factor scale A = 1.2 TeV 
because the resulting anomalous coupling limits would 
have been outside the contours provided by the S'-matrix 
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TABLE I: Summary of the 95% C.L. limits on the real 
parts of the anomalous couplings for a form-factor scale of 
A = 1.2 TeV. Limits are set by allowing only one coupling to 
vary; the other is fixed to its SM value. 
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FIG. 4: The 95% C.L. two-dimensional contour (ellipse) and 
one-dimensional (ticks on the cross) exclusion limits for the 
real parts of the CP-conserving (a) Z77 and (b) ZZy cou- 
plings for A = 1.2 TeV. Dashed lines illustrate the unitarity 
constraints. Both Zyy and ZZ'y limits are within the unitar- 
ity boundaries. 



unitarity. 

In this study we analyzed a sample of 968 ££j events, 
consistent with Z7 production. These data correspond 
to about 1 fb^ 1 of integrated luminosity, roughly three 
times more than what was used in the previous DO anal- 
ysis This current study also takes advantage of nu- 
merous improvements in the detector simulation, par- 
ticle identification, and signal modeling. The cross 
section of the Z7 process is measured to be 4.96 ± 
0.30(stat. + syst.) ± 0.30(lumi.) pb. This value is con- 
sistent with the SM, and is the most precise measure- 



ment of a cross section at a hadron collider. The 
observed photon Et distribution, as well as other kine- 
matic parameters, do not indicate new physics beyond 
the SM, allowing us to set limits on the real parts of 
the anomalous .Z77 and ZZ^ couplings. The one dimen- 
sional limits at the 95% C.L. for CP-conserving couplings 
are -0.085 < hj < 0.084, -0.0053 < hj < 0.0054 
and -0.083 < fcf < 0.082, -0.0053 < hf Q < 0.0054 for 
A = 1.2 TeV. Limits on the CP-violating couplings are 
the same as those on the corresponding CP-conserving 
couplings within the quoted precision. These new limits 
represent a significant improvement over previous results 
and the limits on h\ are the most stringent to date. 
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